I'm running a near identical build but with 2 wired contollers. The only psp games I run are the Williams and Gotlieb pinball games, but they run well on ppsspp. I just had to activate frameskip, otherwise there's minor stuttering.

It may just be that those games are some of the ones that the pi struggles with.